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0 A method of passing task messages in a data processing system. 



0 Processors 5, 7 communicativety attached to a 
storage sub-system 3 place task messages for the 
sut>system on a queue: The processors do not have 
to waH on a queue lock set by another processor or 
sub-«ystem wWlst dequei^ a message. TWs is 
achieved by use of a double ended linlced Gst or 



queue of messages having an tsoiation/ireference 
point wher^ an enqueuing end of the Bst Is k)c- 
Icabie and accessible independently from the de- 
queuing end of the Ost The locking primitive may be 
of the mutti-prooessor kxk synchronizing atomic 
type such as TEST AND SET. 
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Field of the trwentton 

This invention relates to a mettKxl and means 
for passing messages between processors having 
order of magnitude speed differences to avoid the 
rate of message exchange being dominated by the 
lower speed. Such message passing occurs be- 
tween concunrently executing CPU's and an exter- 
nal storage sub-system (e.g. synchronous direct 
access storage device (DASD) array). 

Background of the Invention 

Contemporary high speed processing or super- 
computing conjures up the prospect of 1000 miBion 
instructions per seoond (MIPS) of coordinate com- 
puting across multiple processors aperiodicany re- 
ferencing substantially slower spedaTized proces- 
sors such as direct access storage device PASO) 
array controllers. Synchronization among proces- 
sors still requires a comtMnation of locks and mes- 
sages. Locks serve to bM resources to tasks while 
messages and th^r processing operate as syr>- 
chronizing events. In contemporary systems, task 
oriented messages are enqueued against re- 
sources. Also, ttie queued access is governed by a 
gk)bal k)ck. Thus, (^)erations are paced by the 
skywest processor obtaining locked access to the 
queue. 

A single central processing unit (CPU) or pro- 
cessor typteally includes a k)cal operating system 
(OS), RAM imptemented internal memory, local 
instructkNi and ^data caches operatively fonmed 
from the Intemal menK>ry, an external store, and 
iocK cache, and stcNage resource managers. How- 
ever, high speed or supercomputing involves ap- 
pficatkxis executing over several processors. The 
appGcattons initiate tasks in ttie form of OS instruc- 
ttons (READ/WRITE). These tasks are queued 
against the resources whkii process them, in this 
case, these are the general and ^)ectal purpose 
processors of the high speed system. The tasks 
are relatively synchronized (ordered) with respect 
to each other by their position placement as nnes- 
sages in the queue in a commonly accessible 
portkm of processor shared intemal meiTKiry. 

The messages (tasks) are expressed as encap- 
sulated operations defined over a range of ad- 
dresses. Where the messages relate to accessing 
external storage, they ana enqueued by processors 
In the shared nrtemory and await dequeuing and 
execution by tfte storage sut)-system. Concurrently, 
messages Indicative of altered or completed stor- 
age access tasks are also enqueued by the storage 
sut>«ystem in the sfiared ntenKxy and awcdt de- 
queuing and executkm by the processors. By kx:k- 
ing ttte queue, ttie sk>west processor such as the 
external store (array controller) can pace the entire 



operation. 

As mentk)ned above, synchronization is 
achieved among processors and tasks using 
queued access messages usually controlled by 

5 some fonn of tocWng. However, wfiere there is a 
raw disparity in capacities, then much may go to 
waste wttile the faster processor awaits access to a 
queue currently bound (locked) to a substantially 
skDwer processor. 

10 Even where the processor engages external 
DASD storage without delay, there may be a gross 
ntssmatch of data rates. lUustratively, concurrent 
processors executing 100 MIPS and a 100 
MByte^ec data transfer rate might have to commu- 

75 nlcate with a gigabyte DASD having a 1 to 3 MByte 
transfer rats and a 10 miDtsecond access tima 

Patterson et al, *A Case for Redundant Arrays 
of Inexpensive Disks (RAID)", ACM SIGMOD Con- 
ference, Chk:ago Illinois, June 1-3. 1988 dscusses 

20 the general solution with respect to data rate 
matching in the form of accessing N synchronized 
DASOs in parallel. Synchronous t)ehavior requires 
N DASDs to rotate at the same rpm, have the 
same angular offeet and be accessed in an kien- 

25 tical manner at the same time. 

As an attemative to communicafing data in 
parallel via Patterson's synchronized DASD's. data 
rate mismatch has been managed by intertocks or 
tockable buffers. Buffer size and cc^ have re- 

30 mained as obstacles... - 

Beausoletl et al. USP 3,336,582, "Intertocked 
Conununication System*, issued August 15. 1967, 
shows an interiock over which a k>w speed proces- 
sor paces the transfer from a high speed proces- 

35 sor. That is. a km speed processor such as a 
storage control unit (IBM 3880) strobes a 
C^PU/channel (S/370) over a demand response in- 
terface indicating that it Is availat)le to process the 
next information unit 

40 Cage. USP 4.454,585, 'Buffer For Use Wrth A 
Foced Disk ControHer". issued 6/12A1d84, disck)ses 
a multi-ported random access memory managed 
by address register manipulation as an asynchro- 
nous partitioned circular buffer. Data is read from 

45 or written into consecutive RAM addresses on a 
partition-at-a^me basis in wrap-around (circular) 
order. A partition/bk)Ck consists of a fixed number 
of consecutive RAM addresses sized to hold a 
track sector of data, the RAM buffer having a 

50 capacity of at least two such partitions. 

In Cage's buffer, the speed of the movement of 
fixed bk>cks of data Is matched between the main 
menKMy (DMA) of a word processor and an at- 
tached DASD. A DASD write or read oonunand 

65 results in data t)etng moved eittier from ttie DMA or 
a DASD track sector into a first RAM partition. 
Because RAM operations are asynchronous, a de- 
mand transfer from a second RAM partition can k>e 
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overtapped with the first movement as an atomic 
part of the command (DASD read or write) being 
executed. 

Knuth, The Art of Computer Programming". 
Second Edition, copyright Addison-Westey Pub. 
Co. 1968. 1973, Vol.1 Fundamental Algorithms, 
pages 234-239, 531-S34, describes a "deque* as a 
6near list in which all inserticms and deletions are 
made at the ends of the fist He further defines an 
"input restricted deque" as a linear list in which 
Items may be inserted at one end and removed 
from the other end (Sec.2.2.1 Exercise 1). 

Disdosure of the Invention 

The Invention provides a method of passing 
task messages in a data processing system includ- 
ing a plurality of high-speed processors, an exter- 
nal storage sutjsystem. and shared Internal mem- 
ory, said method comprising the steps of: defining 
a first finked fist in the shared internal memory with 
separately tockable first and second ends; and 
operating s^ ^ as a queue of task messages 
passing between the high-speed processors and 
the storey subsystem, k)ckably enqueuing task 
messages at the first end of the queue and In- 
dependently k)ckably dequeuing task messages 
from the second end of the queue. 

Preferably tfie method further comprises the 
steps of defining a second finked fist in the shared 
bitemal memory with separately kxtable first and 
second ends; and operating said second fist as a 
queue of task messages passing between the high- 
speed p rocessors and the storage sut>sysitem, vrith 
task messages being k)ckably enqueued by the 
external storage subsystem at the first end of the 
queue, and Independently task messages being 
k>ckably dequeued by the high speed processors 
from the second end of the queue. Correspond- 
ingly, on the first fist task messages are enqueued 
at sakl first end of the queue by the high-speed 
processors, and dequeued from the second end of 
the queue by the external storage subsystem. 

In a preferred embodiment rsfererx^e points 
arxj operator sets are defined over said first and 
second fists, one reference point l)^ng associated 
with the second end of each fist and each operator 
set induing top of list (TOO) and bottom of fist 
(BOQ) pointers, and top of list (TOOL) and bottom 
of list (BOQL) k)ckwords. A first k)ck is obtained by 
one of the processors on said second end of ttie 
first fist upon said one processor matching the 
BOQL, whereupon task messages are embedded 
between the reference point and the last message 
In the fet and sakl first lock is released. A second 
lock can t>e obtained by the sutjsystem on said 
first end of the first list upon said sut>system 
matching the TOQL. altowing one or more task 



n^ssages to be removed from said first fist before 
s^ second kx:k Is released. Only the hcAler of 
sakl second lock (TOOL) may alter any pointer to 
the non-reference end of the fist or any of the task 
s messages in tfie fist and only the holder of ttie first 
kx:k (BOQL) may alter any pointer designating the 
reference point end of the fist 

It is also preferred that the processors originate 
task messages in tfie form of control blocks 
to (DOB'S) for the subsystem, each DOB specifying 
one or nrxxe access operatk>ns to 1)0 executed by 
sakl subsystem, said DCB*8 being enqueued on 
the first fist by the originating processors, and sakl 
subsystem dequeuing and processing each DOB 
76 from said first list according to either an external 
disdf^ (UFO, HLO. RFO) or according to a 
priority reordering of said first fist or portkxi tiere- 
of. Each DOB assumes either a waiting, active, or 
completed status, the waiting OC^'s constituting 
20 the first fist active DOB's being cunentty pro- 
cessed, and completad DCB's constituting the sec- 
ond list The subsystem then processes task mes- 
sages dequeued from sakl first fist updates each 
task message, and enqueues the updated task 
25 messages onto the second fist said originating 
processors dequeung and processing each up- 
dated task message from said second fist accord- 
ing to etther an external disctpfine (UFO. FILO. 
FIFO) or to a priority reordering of sakl second fist 
30 or portion tiiereof. , 

The Invention also provkles a data processing 
system inducfing a pluralily of high-speed prxes- 
sors. an external storage subsystem, and shared 
intemal menwry, sakJ system further including: 
35 means for dining first and second finked fists In 
file shared memory each witti separately kx:kable 
first and second ends: means for operating sakj 
first and second fists as wait and oompietiCHi 
queues of task messages respectively, tockably 
40 enqueuing task messages at the first end of a 
queue and independ^itty kxkably dequeidng task 
messages from ttie second end of the queue; 
means responsive to task messages originating 
from processors for writing the task messages into 
45 ttie shared memory, finking said task messages 
into the wait queue, and ^gnaOing the storage 
sut»system accordingly; means at ttie storage sul>- 
system aperiodically responsive to sakl signalting 
for dequeuing the task messages from the wait 
60 queue, actively proces^ng the dequeued ta^ mes- 
sages, enqueuing the processed task messages 
onto ttte completion queue in said shared memory, 
and signalling the processors accordingly; and 
means aperiodically responsive to the subsystem 
66 Signals for dequeuing the processed task mes- 
sages from ttie completion c^jeue. 

The at)Ove mettiod and means permit proces- 
sors of disparate speed to have overiapped access 
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to either add or remove messages in queued ac- 
cess (position order processing) fetation to each 
other. Thus processors such as a CPU and an 
external storage sut)system placing a message on 
a queue no longer have to wait on a queue lock set 
by another processor or sut>system dequeuing a 
message. A double ended linked fist or queue of 
messages is used, preferabty with an 
isolation^reference point (NULUBLANIQ. An en- 
queuing erKl of the list (BOQ/BOQL) is ktckable 
and accessible independently from the dequeing 
end of the Cst (TOQ^OQl). Typically the method 
and means utilize simple meta-prooessor lock 
pdmitives Qn this regard, *meta-processor" de- 
notes available to all processors). The fax^king 
f^imitive nrtay be of the mutti-processor k>ck syn- 
chronizing atomic type such as TEST AND SET. 
The processor obtains a kx:k, when available, be- 
fore inserting messages between the first end and 
the last message on the first queue, and then 
releases the lock. Likewise the subsystem obtains 
a kx:k, when available, before Inserting messages 
between lha first erKj and the last message on the 
second queue. The avalability of a k)ck can be 
testad by comparison matching BOQL with the 
result from executing the kxk primitive. 

Thus, in other words, task oriented messages 
can be passed between a phirality of high speed 
processors and a relatively km-speed external stor- 
age subsystem communicatively coupled over a 
shared memory, using opposHely poled queues. 
First and second dense finked finear lists are de- 
fined in the shared memory, each ist having in- 
dependentty lockable first and second ends. A first 
kx:k is obtained by a processor on the first end of 
the first fist wften available, tiie processor inserting 
messages between the first end and the last mes- 
sage so finked, and r^eastng sakJ first kKk. The 
subsystem (Mains another kx^k on the second end 
of the first list when available, removir^g messages 
anywhere on tfie fist and releasing said other k>ck. 
On the first and second ends of ttie second fist the 
roles of tfie storage sut>-ystem and processors are 
reversed. 

Brief Description of the Drawings 

Figure 1 sfiows a CPU/ DASD anray data flow 
emphasizing shared internal memory, high perfor- 
mance ctiannel interface (HPO), array controller, 
and DASD*s. 

Figures 2A-C respectively depict a waft queue, 
an ^rtive fist and a completion queue of DASD 
control bkx^ks (DC6*s) selectably k)ckable at eitiier 
end thereof. 

Rgure 3 illustrates ttie enqueue operation on a 
DC6 wait and completion queue. 

Figure 4A-B sets forth tf^e dequeue operations 



on a respective first and second example of a DCS 
wait and completion queue. 

Detailed Description 

6 

The preferred emtjodiment of this invention 
uses a high speed multi-processor fK>st interacting 
with a skmer external store. The external store is 
illustratively expressed as a synchronous array of 

10 N DASD's arKi an array controller. To enhance 
appreciation of this form of extendi storage, a k>rief 
description of data organization on the array 
(striping) and the use of information redundancy 
(parity bkx:ks, ECC) is provided. 

16 Patterson's type 3 DASD anray synchronously 
reads and writes to N DASDs In column mcjor 
order. However, N-1 of the DASD's contain data 
and one DASD contains a parity ranging over the 
ottier data DASDs. That is. one check DASD is 

20 provided for tfie group. The contents of the felled 
DASD can t>e reconstructed in the manner of 
Ouchi. US Pat 4.092.732, "System for Recovering 
Data Stored in a l^led Memory Unit*, issued May 
30, 1978, wtiich (fisck>ses the spreading of data 

25 bkx:ks from the same io^flcal file across a string of 
N- 1 DASD's and recording a parity bkKk on tite 
Ntti DASD. The parity bk)ck is an XORing of the 
parity contents of the N-1 otiier bkx^ks. Contents 
from any single inacoesslt>le DASD can be recov- 

30 ered by XOf^ tiie parity btocks witii ttie bkxks 
stored on the N-2 remaining acoessa>te DASD's. A 
similar result can be achieved if the parify bk>cks 
are not avail^)la . 

Typteally in bk>ck oriented data, a parity suffix 

as or eqwvalent (Hamming, CRC) is appended to 
each data Mock. Thus, each parity suffix can be 
invoked to deted/oorrect intra-bk)ck error. As de- 
scribed in Ouchi, when one or more of the bkx:ks 
of an N-1 sequence are unavailable, a parity bk^k, 

40 whteh a prtori spans tiie N-1 bkx^k sequence, is 
used in conjunction with the remaining bkx:ks to 
rebuitel ttie unavailable data bkx^k. Efficient codes 
per se (Hamming. Cyclic Redundancy Check, 
Reed-Sotomon) are elsewtiere treated in tiie litera- 

45 ture. 

Referring now to Rgure 1, there is shown a 
system including a an array of processors 1 cou- 
pling as external storage a synchronous DASD 
anray 3. The processors 5, 7, 9 are of tfie high 

60 performance variety such that wtien operated con- 
currently they have processing speeds in ttie order 
of 100 -I- MIPS. A sk)wer special purpose processor 
In ttie fbmn of DASD anray 3 is coupled to array 1 
by way of adapter 15. Other information processing 

65 sources or sinks such as kxal area networks, print- 
ers, or displays wouW likewise bo coupled over 
counterpart adapters 17. 

The fast and stow processors communicate 
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wtthin array 1 cveraveryNgh speed bus 11 using 
a portion of shared mtemaJ ff^ 13 as a special- 
ized message reposftory. Ttie prooessors constitute 
a distributed peer coupled system wHh no central- 
ized operating system or process control. All re- 
sources such as intemal memory 13, Interrupt fa- 
cility, and global registers (not shovm) are availaWe 
to any processor including the external storage or 
DASD anay subsystem (DAS) 3. 

DAS 3 pref^ly comprises a RAID3 type 
DASD array and an associated array controller as 
described for example In tfte Patterson reference 
and In the ohpwKling Brady et al. application, EP 
91304S03-5. •METHOD AND MEANS FOR AC- 
CESSING DASD ARRAYS WITH TUNED DATA 
TBANSFB) RATE AND CONCURRENCY", 
(Appncanfs rsf . no. SAMCW28). Even flwugh D^ 
operates in a peer-coupled relationship ¥nth the 
other processors, it nevertheless queues task ori- 
ented messages against other processors or re- 
sources. Any change in the queue or other action 
requests such as halt current operations are in- 
cficated by way of spedal purpose signals Qap 
signals). 

DAS receives tasks as messages and oommu- 
rtfcates the results of task processing via control 
bkx:ks arranged in the form of a dedicated queue. 
This queue, as exemp&fied in Figure 2, remains in 
host 1 Intemal memory 13. The system Includes a 
facinty to reorder the queue according to changing 
system prtorfties. 

Refonfng again to Rgune 1. there Is shown an 
array oontroOer (elentents 19^1) coupCng the host 
bus 11 by way of channdl adapter 15. This path 
provkles access to all system resources InchKfing 
memory 13. gtobal regi^ers. and tap signals on 
behalf of DAS 3. Adapter 15 preferably attaches 
DAS over a pair of sinnplex megabyte rate receive 
and transmit interfaces 19, 21. The interfaces, 
known also as High Performance ParalleltntBrfaces 
(HIPPO, ate descrfoed in the ANSI Draft Standard 
of 8/2d/1989. X3T9/88-127, Revision This facili- 
tates receipt of the so-called tap signals from the 
host and access to the host as initiated by DAS. 

Host or system functions available for DAS use 
Include READ/WRITE Intemal rrwnory 13. atomfc 
TEST AND SET for lock operations in internal 
memory 13. atomic operations on gtobal registers, 
receipt and interpretation of tap signals from other 
processors or system elements, and ttie generation 
<^ tap signals to the system or host 

DAS 3 operates one addressable array of 
DASD*s 33. 35, 37 synchronized via sync circuit 39 
to each rotate at the same rpm. have the same 
angular offset, and be accessed In an klentk»l 
manner at the same time. This solutkx) maximizes 
date transfer rate. This permits f^ speed sequen- 
tial or skip sequential DASD date transfer. 



Date movent In the Host/DAS direction 
starte from Intemal memory 13 over bus 11 
through adapter 15, receiver 19, ending in striping 
and parity fogic 23. Logk: 23 Includes the neces- 
5 sary digital and timing drcuite to catoulate a parity 
bk)Ck by XORing the N-1 date bktcks and transfer- 
ring counterpart blocks to ones of ttw buffer and 
ECC drcuite 27, 29. and 31. Each bUxM Is also 
protected by apperKfing an ECC byte thereto for 
to error detection and correction on an intra-bk>ck 
bass. Access to the N DASD*8 is made synchro- 
nously in the conventional manner. The obverse 
obtains when date movement proceeds in the 
DAS/Host direction. 
f6 The task or request is defined in a control 
block termed a DASD Control Bkxk or DCB. A 
processor at the host buikls a DAS DCB In internal 
memory 13. It then Enks tiie DCB to a WAIT queue 
for DAS and signals the enqueuing operation. Sut>- 
20 sequentiy, DAS moves tiie DCB onto the ACTIVE 
LIST, perfbmns DCB requested functions, updates 
the DCB and places it on the COMPLETION 
queue. After detecting the I/O completion, the host 
dequeues the updated DCB from the COMPLE- 
25 TION queue and ascertains tite outcome of the 
DCB specified operation. 

Restated, a DAS I/O request Is responsive to 
any processor 5-0 invoking a READ/WRITE from 
Hs OS. A DCB Is bdit and placed on a WATT 
so queue k)cated in Intemal memory 13. A tap signal 
is then sent to DAS. In turn, the DAS inspecte the 
queue for tie next queued DCB using any one of a 
number of work management dgorittims (RFO. 
^ RLO, UFO etc). DAS does not need to respond to 
35 the tap signal as a prtority event - 

Referring now to Figures 2A-C. the system is 
ananged such that the DAS "tesk WATT queues" 
are priority ordered. A request may be rek)cated in 
the queue relative to otiieriasks or DCB's at any 
40 time prfor to ite being made active by ttw DAS. In 
this invention, such reordering is a special function 
of a DEQUE operation to be explained subse- 
quentfy. Note, that the DCB's remain at tiie same 
intemal memory 13 real address irrespective of 
45 changes in queue finking priority or active/Waiting 
status. 

One of ttte attributes of peer-coupled proces- 
sors is ttiat the DAS is responsive to receipt either 
of a tap signal or ite work mariagement algorithm 

GO by finding the next queued DCB vte reading an 
anchor pointer In intemal memory 13 established 
during kmiallzation and changing the first waiting 
DCB status from "WAITlng" to "active. TWs is 
accompOshed by moving the DCB show in Figure 

GS 2A to the ACTIVE UST per Figure 2B. TWs is 
brought about by the OAS executing a sequence of 
intemal memory access operations. Once tiie DCB 
is "active", the DAS processes the DCB according 
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a function code contained In said DCB. Rsiatadly, 
address Information fn the DCB define the extent of 
data to be transferred. In tfiis regard, the data 
transfer is effectuated tsy DAS initiated operations 
through the channel adapter 15. 

It should be appreciated that each DCB can 
assume one of three states, namety, "active", 
■waiting", or "completed". 

When a data transfer operation is completed, 
the DAS writes completion status in the DCB. 
changes the DCB state as per Rgura 2B from 
"active" to "completed", and enqueues the DCB 
on the assoctatad completion queue per Rgure 2C. 
Also, the DAS may execute a numt)er of DCB 
specified completion rxstification primitives. Signifi- 
cantfy, the transfer of data to and from internal 
memory 13 and the DAS is under DAS control 

Remaning still to Figures 2A-C, thera aro shown 
several queues of DCB's. Each queue element 
generically called QR , is a contiguous set of 
words in a memory which both processor classes 
can fetch from and store to In shared memory ia 
A QEL includes message words as well as a fink 
pointer word required for queu^. Although each 
QEL could be a (fifferent length, advantageously a 
simple system might use uniform sized QELs of. 
perhaps. 32 words each. Typically, each sharad 
memory word Itself consists of at least enough bit 
positions to contain the address of any other word. 
For example each word of sharad memory could 
be 64 bits long. * ^ o ^ 

A pointer to a QB. is the address of one of the 
words in the OB. (as used in this specification and 
F^ures 2AC, the term 'pointer? refers either to an 
address, or to a place where such an address is 
found). Context determines which is meant The 
word pointed to, the fink pointer word. normaOy 
contains tt>e address of another QQ^ but can con- 
tain a pradetermined null value such as all bits off, 
or ail on. 

As illustrated Figures 2AC, a Blank-OEL is a 
QEL whose fink pointer word is null. Also, a queue 
may be fonned from eitfter a single Blank-QEU or 
a set of QELs linked one to another by pointers 
leading from a top QEL to a t)OttDm QEL. The latter 
is always a Blank-QEL when the bottom pointer is 
unlocked. 

Queues are kx:ked by using a multiprocessor 
synchronizing kx:k operation available to all partici- 
pating multiprooessor classes. An example Is the 
classic Test and Set operation whkii stores a lock 
constant to a word of shared memory. If the pre- 
ceding fetch, which Is part of the same atomic 
operation, returns a value other than this took con- 
stant then the Test and Set operatton has success- 
fully kx*ed the kxk word. 

A queue header consists of four words m the 
shared memory as sfKmn following: 



TOQ Top of Queue Pointer Sharad mem- 
ory address of link pointer word of the 
top QEL in the queue. 

BOQ Bottom of Queue Pointer Shared 
s memory address of Gnk pointer word 

of tfie tx3ttom QEL in the queue. 

TOQL TOQ Lock Word. For example a Test 
and Set lock word. Only the holder of 
the TOQ kKk may after the TOQ 
10 pointer or any of the contents of 

QELs linked above the QEL pointed 
to by BOa (Note that the BOQ point- 
er may cfiartge while TOQ is locked; 
see BOOL) 

16 BOOL BOQ Lock Word. Only the holder of 
the BOQ kx:k may alter the contents 
of the QEL at the bottom of the 
queue, possibly making it non-blank. 
Only the BOQL processor/hokler may 
20 change the BOQ pointer v^ue, and 

then only if the new value Is the ad- 
dress of a valid Blank-QEL 
Changing the BOQ pointer moves to teolatkui 
point between the ertqueuing and dequeuing pro- 
25 cesses. Once the BOQ is changed, the BOQ k>ck 
holder's authority to update is reduced to the New- 
Blank-QEL and to the BOQ pointer. A TOQ tock 
hokier is always free to update any QELs down to. 
but not including, the QEL pointed to by the BOQ, 
30 whether the BOQ is locked or not . 

Applying the above definittons to Rguras 2A-C, 
there are shown oonstnicte incficative of me three 
states into .whtoh each DCB must t>e resolved (wait 
act^e. completed). DCB's classified as waiting or 
35 completed are enqueued while an active DCB is 
being processed. In each queue, each DCB has a 
pointer to the next DCB in the chain. The BOQ 
points to a null or blank DCB operative as tfie 
queue bottom while TOQ points to the most recent 
40 queue adcfition. 

Refening now to Figure a. there is depicted an 
enqueue operation as the loading of a message 
into the Blank-QEL at the bottom of a queue, and 
the appending to ttie txjttom of the queue of an 
45 additional QEL as the New-Blank-QEL The en- 
queue operation includes the steps of: 

1. locking BOQ. condittonally waiting for the 
queue to t>ecome available: 2. writing a null into 
link pointer of the additional QEU "New-Blank"; 3. 
so writing the memory address of New-Blank into 
Linkage Pointer of Oto-Btank; 4. toading a message 
into the former Blank-QB^ *Old- Blank*; 5. putting 
memory address of New-Blank Into the BOQ point- 
er word; and 6. unlocking BOQ. 
65 The original queue has not been alterod except 
for the contertts of the original Blank-QEL. Ihe 
original Blank-QEL was Initialty at the bottom of the 
queue. Only the processor/hokler of the TOQ kx:k 
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may attar the queue's non-blank QELs. 

lha enqueutng processor can add mora than 
one QEL. tn preparation for enqueutng, the addi- 
tional QELa are to be finked one to another from 
Top-AddnhOEL to Bot-Addnl-QEL The steps are 6 
listed below in an order which continuously main- 
tains a weO formed queua Mote, a Vrell formed 
queue* refers to a TOQ-BOQ pair and its asso- 
datad queue cortforming to the above definitions. 

1. lockino BOQ. perhaps waiting for H to be- to 
come 8vailat)le; 

2. putting nulllnto Gnk pointer of Bot-Addn^QEL. 
making fit NewBlanlq 

3. k>ading messages into Old-Blank, and all 
Addnl-OELs except New-Blank; rs 

4. putting memory address of Top-Addnl into 
link pointer of <Md Blank: 

& putting address of New-Blartk into BOQ; and 
6. unkx:king BOQ. 

Referrfng now to Figures 4A-B. there are de- ao 
picted two examples using a DEQUE operation in 
whkii a single QEL is ramoved from tfie top of a 
queue. A processor copies into fhe TOO the oonr 
tants of the Gnk pointer from the first QEL in the 
queue. To renruive a continuously linked sequence 2S 
of QELs, a processor changes the TOQ poirtter. or 
a single QEL link pointer, so as to point around the 
QELs being removed. The dequeue steps are Ist- 
ed bekyw In an order whteh continuously maintains 
awell formed queue. ^< - so 

1. if TOQ s BOa eodting without k)cking as 
queue is empty of non4>lanks; 

2. kxMig TOQ. comfitionafly after waiting for It 
to become avsdlable; " 

a reading BOQ. any QEL at that address or ss 
linked beyond it Is ineligible; 

4. ramoving one or more eGgible QELs from 
anywhere on the queue; and 

5. unk)cking TOQ. 

The QEL pointed to by BOQ. when BOQ is 40 
read, is treated as ineTtgit:^. While a BOQ kx:k 
hokier may make tills a valid QEL and may change 
BOQ. the QEL will remain ineltgtbte for this execu- 
tion of enqueue or reorder. 

Reordering is a two step process in which 45 
QEL(s) are first dequeued from, and then r^nser- 
ted into, the eligible QEL chain. The processor 
doing flie reordering holds the TOQ kx* for Itie 
duration of t)oth steps. So to move a single QEL, 
called •Moving-QEL*. to the top of the queue, a so 
processors dequeues the QEL, as defined pre- 
viously, and then reinserts It by chan^ng Moving- 
QEL's »nk pointer to the value In TOQ, and putting 
the address of Movlng-QEL into TOQ. 

tn a similar manner a processor can dequeue ss 
any number of eligible QELs, Gnk ttiem togetiter In 
one or more fragmentary chains, and then reinsert 
the fragmertts back into the queue. Reinsertion can 



be done maintaining a wea formed queue by: 

1. settir^ ink poimer of fragments final G£Lto 
address of QEL that will foDow fragment in 
queue; and 

2. setting TOQ pointer, or Gnk pointer of QEL 
that is to precede fragment, to the address of 
first QEL in fragment 

For any operation to continuously maintain a 
well formed queue, each single word storage up- 
date of a poiftter in shared memory must complete 
fully. If a process then foOows the steps of an 
operation in the order given, the queue wiD remain 
well formed. bi the event of most hardware ^lures. 
or of a premature process termination, some in- 
transit QELs may not be on the queue, but the 
queue Iteelf will remain weU formed. Ottier pro- 
cesses win be able to continue working witti such a 
queue. 

In the initia] example the alk)cation of shared 
memory can be a processor only function. This can 
be achieved by having the controllers reuse each 
work queue element as the QEL in whk:h to report 
completion status. 

Claims 

1. A mettKxl of passing task messages in a data 
processing system including a plurafity of high- 
speed processors ^, 7), an external storage 
subsystem (3), and shared internal memory 
(13), saM mettiod comprising the steps of. 

defining a first Gnked Gst in the shared 
internal memory witti separately kx:kable first 
and second ends; and 

operating s^ Gst as a queue of task mes- 
sages passing between the high-speed pnxes- 
sors and the storage subsytem. k)ckab}y en- 
quemr^ task messages at the first end of ttie 
queue and independentty kKkably dequedng 
task messages from the second end of the 
queue. 

2. A mettKXi as claimed in claim 1, in which the 
task messages are enqueued at said first end 
of ttie queue by the htglHspeed processors, 
and dequeued from ttie secortd erul of the 
queue by the external storage subsystem. 

3. A method as claimed in claim 2, further com- 
prising the steps of. 

defining a second Gnked Gst in the shared 
Intemal memory with separately kx:kable first 
arKi second ends; and 

operating said second Ust as a queue of 
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task messages passing between the high- 
speed processors and the storage s u t?systBm, 
task messages being tockabty enqueued by 
the external storage sut^system at the first efKl 
of the queue, and irtdependently task mes- 
sages bGAvg k>ckably dequeued by the high 
speed prcKessors from the second end of the 
queue. 

4. A method as claimed in claim 3. further com- 
prising the steps of: 

defining reference points and operator sets 
over said first and second fists, one reference 
point being associated with the second end of 
each fist, and each operator set including top 
of fist (TOO) and bottom of fist (BOQ) pcMnters, 
and top of fist (TOOL) and bottom of fist 
(BOQL) k>clcwords: 

obt^ning a first lock by one of the (mces- 
sors on said second end of the first fist upon 
sakl one pnx:essor matching the BOQU em- 
bedding task messages between the reference 
point and the last message in the fist and 
releasing sakl first k»ck: 

obtai rung a second lodk by the subsystem 
on ssad first end of the first fist upon s^ 
suttsystem matching the TOQU renraving one 
or rnore task inessages from said first fist, and 
releasing sakJ second kx:k. 

& A metfKXJ as claimed in daim 4, wherein only 
the hokier of said second k>ck (TOOL) may 
alter any pointer to ^ r)on-reference point end 
of the fist or any of the task messages tn the 
fist, and further wherein only the holder of the 
first k>ck (B0QL4 may alter any pointer des- 
ignating the reference pCMnt end of the fist 

6. A method as claimed in any preceding claim, 
wherein said metfuxJ further comprises the 
step of: 

reordering the fist of task messages by 
otjtaining a k>ck on the second end of tfte first 
list wften available, removing task messages 
from anywhere on ttie fist linking at least some 
of the dequeued task messages together in 
one or more fragmentary ctiains, and then rein- 
serting the fragmentary chains t>ack into the 
queue, and releasing the kx^k. 

7. A method as claimed in any of dsdms 2 to 6, 
wtterein the processors originate task mes- 
sages in the form of control bkx^ks (DCB*s) for 
the sut>system. each DC8 specifying one or 



more access operations to be executed by 
said sut>system. said DC8's being enqueued 
on the first fist t>y the originating processors, 
and said sut>system dequeuing and processing 
5 each DCB from said first fist according to 

either an external disdpfine (UFO. RLO, RFO) 
or according to a priority reordering of said 
first fist or portkKi tfiereof. 

ro 8b A ntethod as claimed in daim 7. wherein each 
DCB assumes either a waiting, active, or com- 
pleted status, the waiting DCB*s constituting 
the first fist, active DCB's t>eing currentiy pro- 
cessed, and completed DCB's constituting the 

76 second fist 

9. A method as claimed in claim 7 or 8, wher^n 
the subsystam processes task messages de- 
queued from said first list updates each task 

20 message, and enqueues the updated task 
messages onto the seoorKj fist, said originating 
processors dequeuing and processing each 
updated task message from said second fist 
according to either an external discg)fine (UFO, 

25 RLO. RFO) 0(tD a prk>rity reordering of said 
second 1^ or portion ttiereof . 

10. A data processing system including a plurafity 
of high-speed processors (5, 7), an external 

30 storage subsystem (3), and shared internal 
memory (13), said system further including: 

means for defining first and second finked 
fists in the shared memory each with sepa- , 
as rately kxtoble first and second ends; 

means for operating said first and second 
fists as wait and completion queues of task 
messages respectively. kx:kably enqueuing 
40 task messages at the first end of a queue and 
independentiy kxksbty dequeuing task mes- 
sages from the second emj of the queue; 

means responsh^e to task messages origi- 
45 nating from processors for writing the task 
messages into ttte shared memory, finking said 
task messages into the wait queue, and signal- 
ting ttie storage sut>system accordingly; 

50 means at tt>e storage sut)system 

aperkxlically responsive to said signalfing for 
dequeuing ttte task messages from ttie wait 
queue, actively processing the dequeued task 
messages, enqueuing the processed task mes- 

65 sages onto the completion queue in sakt 
sliared ntemory. and signalfing ttie processors 
accordingly; and 



8 



<EP 04ee33QA2 I > 



15 EP0 466 339 A2 16 



means apedodicalty responsive to the sub- 
system signals for dequeuing the processed 
tasic messages from the completion queue. 
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